VISIRE: photorealistic 3D reconstruction from video sequences
نویسندگان
چکیده
Traditionally, building 3D reconstructions of large scenarios such as a museum or historical site has been costly, time consuming and required the contribution of expert personnel. Usually the results showed an artificial look and had little interactivity. However, newly developed technologies in the areas of video analysis, camera calibration and texture fusion allow us to think in a much more satisfying scenario where the user with the only aid of a domestic video camera is able to acquire all the information it is required to construct the 3D model of the desired environment in an easy and comfortable manner. In this paper, the results obtained in the EC funded project VISIRE are presented. VISIRE attempts to construct photorealistic 3D models of large scenarios using as input multiple freehand video sequences. Once acquired, the computer vision software will process the video information off-line in order to obtain the 3D mesh together with the textures required to obtain a 3D model highly resembling the original.
منابع مشابه
Model-to-image Registration and Automatic Texture Mapping Using a Video Sequence Taken by a Mini Uav
3D city models are used in many fields. Photorealistic building textures find applications such as façade reconstruction, thermal building inspections and heat leakage detection using thermal infrared (TIR) images, quantitative evaluation or study of the materials lying on the object’s surface using multispectral images. Often texturing cannot be done using the same data which was used for 3D r...
متن کاملImprovement of the Fidelity of 3d Architecture Modeling Combining 3d Vector Data and Uncalibrated Image Sequences
The goal of this work is to create a system for improving large architectures models with relatively few uncalibrated image sequences and produces interactively navigable and photorealistic 3D scene. The novel idea is based on the combination of spatial 3D vector data and uncalibrated image sequences to improve the fidelity of 3D architecture models in an extended urban area. First, the spatial...
متن کاملModel-based Video Coding with Generic 2d and 3d Models
3D extraction from video gives a representation adapted to low bitrate coding and provides enhanced functionalities such as 3D cues for augmented reality and interactive navigation in photorealistic environments. But for degenerated motions of camera, like pure rotation, 3D information can not be retrieved. In this article we propose an original representation based on a hybrid 2D/3D models str...
متن کاملHand Gesture Recognition from RGB-D Data using 2D and 3D Convolutional Neural Networks: a comparative study
Despite considerable enhances in recognizing hand gestures from still images, there are still many challenges in the classification of hand gestures in videos. The latter comes with more challenges, including higher computational complexity and arduous task of representing temporal features. Hand movement dynamics, represented by temporal features, have to be extracted by analyzing the total fr...
متن کاملRapid Interactive 3D Reconstruction from a Single Still Image
We present a method to create photorealistic 3D models from a single still image. The user provides input in the form of “scribbles”— within a few seconds of user input, our algorithm generates a photorealistic 3D model and a 3D flythrough from the image. Our approach uses a machine learning algorithm that learns the relation between (single) image features and depth. In our preliminary experim...
متن کامل